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DETAILED ACTION 

1. This action is responsive to communications: Application filed 24 July 2003. Claims 1- 
40 are pending. 



Information Disclosure Statement 

2. The information disclosure statement(s) (IDS) submitted on 24 December 2004 is in 
compliance with the provisions of 37 CFR 1.97. Accordingly, the examiner has considered the 
information disclosure statement. 

Claim Rejections - 35 USC §102 

3. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that form the 
basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public use or on 
sale in this country, more than one year prior to the date of application for patent in the United States. 

4. Claims 1-8, 10-11, 13-15, 17-18, 20-28, 30-31, 33-35, 37-38, and 40 are rejected under 
35 U.S.C. 102(b) as being anticipated by Pizano et al. (EP o 865 189 A2) referred to as Pizano 
hereinafter. 

Claims 1 and 21 : Pizano discloses a method and apparatus for inserting a user's 
annotations into a message, comprising: 

i. providing a speech rendering of said original message (Abstract); 

ii. annotating said speech message with at least one speech annotation (Abstract); and 

iii. inserting said speech annotation into said original message (Abstract). 
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Claims 2 and 22 : Pizano discloses a method and apparatus as per claims 1 and 21 above 
wherein said original message is a text E-mail message (page 2, lines 15-20). 

Claims 3 and 23 : Pizano discloses a method and apparatus as per claims 1 and 21 above 
wherein said original message contains at least one attached document (page 2 5 lines 22-26, Fig. 
16). 

Claims 4 and 24 : Pizano discloses a method and apparatus as per claims 1 and 21 above 
wherein original message is a voice message (page 2, lines 29-33). 

Claims 5 and 25 : Pizano discloses a method and apparatus as per claims 2 and 22 above 
wherein said step of providing a speech rendering of said original message comprises converting 
said text message to speech (page 5, lines 25-26, 'given the option to receive an audible version 
of the message over the phone,'). 

Claims 6 and 26 : Pizano discloses a method and apparatus as per claims 3 and 33 above 
wherein said step of providing a speech rendering of said original message comprises converting 
said attachment to speech (page 2, lines 34-36, 'controls a media converter which converts media 
to fax or media to audio and an audio/fax player,' [emphasis supplied]). 

Claims 7 and 27 : Pizano discloses a method and apparatus as per claims 1 and 21 above, 
further comprising the step of connecting to the mailbox of said email message by establishing a 
voice connection using a landline telephone or a mobile telephone (page 3, lines 27-28; Fig. 2). 

Claims 8 and 28 : Pizano discloses a method and apparatus as per claims 1 and 21 above 
wherein said annotating step includes recognition of predefined commands for starting and 
stopping said speech annotation (page 4, lines 27-28, 'Message generator 23 records voice from 
the user;' page 5, lines 35-55 discloses a sample of an interaction where a user controls the 
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functions regarding review, start, stop, etc. . .). Therefore, it is inherent that if a user has the 
ability to record their voice and review/save recognized input using interaction with the system 
over the telephone, that one would be able to control the starting/stopping of messages. 

Claims 10 and 30 : Pizano discloses a method and apparatus as per claims 8 and 28 above 
wherein said commands are entered via Dual Tone Multi-Frequency (DTMF) tones (page 5, lines 
35-55). 

Claims 11 and 31 : Pizano discloses a method and apparatus as per claims 1 and 21 
above, further comprising the step of using an interactive voice response (IVR) (page 5, lines 31- 
55 discloses wherein a prerecorded voice interactively responds to commands spoken and 
entered via DTMF by a user.). 

Claims 13 and 33 : Pizano discloses a method and apparatus as per claims 1 and 21 
above, further comprising the step of recognizing said speech annotations of said caller (page 4, 
lines 27-29). 

Claims 14 and 34 : Pizano discloses a method and apparatus as per claims 1 and 21 
above, further comprising the step of converting said speech annotations to text (page 4, lines 27- 
29, 'composes it as an E-mail message,'). 

Claims 15 and 35 : Pizano discloses a method and apparatus as per claims 14 and 34 
above wherein said step of converting annotated voice command to text is accomplished using 
Automatic Speech Recognition (ASR) and Speech-to-Text conversion (page 4, lines 27-29, 
'composes it as an E-mail message,'). 
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Claims 17 and 37 : Pizano discloses a method and apparatus as per claims 1 and 2 1 
above, wherein said speech annotation is inserted in said original message as a sound file (page 
5, lines 5-11). 

Claims 18 and 38 : Pizano discloses a method and apparatus as per claims 1 and 21 
above, further comprising the step of storing said annotated message at the Unified Messaging 
server after inserting said speech annotation into said message (page 4, lines 28-31). 

Claims 20 and 40 : Pizano discloses a method and apparatus as per claims 1 and 21 
above, further comprising the step of forwarding said annotated message to another user (page 4, 
lines 23-29). 

Claim Rejections - 35 USC §103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 

obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

6. Claims 9, 12, 29, and 32 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Pizano in view of Kurganov (US 2001/0054085 Al) referred to as Kurganov hereinafter. 

Claims 9, 12, 29 and 32 : Pizano discloses a method and apparatus as per claims 1 and 21 
above, however, wherein Pizano does distinctly disclose a user having the capability to interact 
with a system using predetermined commands, Pizano fails to distinctly disclose wherein said 
commands are user-defined speech commands. However, Kurganov does disclose a personal 
voice-based system for gathering information by use of commands, specifically disclosing the 
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use of user assigned speech commands for interacting with and causing an automated system to 
perform desired tasks (Abstract, This record identifies the location of the information source and 
also contains a recognition grammar based upon a speech command assigned by the user. Upon 
receiving the speech command from the user,'). 

Therefore, it would have been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Kurganov in the system of Pizano because speech 
recognition allows a user to perform said tasks simply by the use of a telephone as well as 
provide a level of customization suited to each user (Kurganov, col. 1, paragraphs [0004]- 
[0007]). 

7. Claims 16 and 36 are rejected under 35 U.S.C. 103(a) as being unpatentable over Pizano 
in view of Handley (USPN 5,349,648) referred to as Handley hereinafter. 

Claims 16 and 36 : Pizano discloses a method and apparatus as per claims 1 and 21 
above, however failing to, but Handley does, disclose the automatic insertion of text when 
correcting or annotating a document (e.g. E-mail) (col. 16, lines 29-34). 

Therefore, it would haye been obvious to one having ordinary skill in the art at the time 
of invention to include the teachings of Handley in the system of Pizano because this would 
save a substantial amount of time and energy, especially when dealing with numerous messages 
(Handley, col. 16, lines 25-30). 



8. 



Claims 19 and 39 are rejected under 35 U.S.C. 103(a) as being unpatentable over Pizano. 
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Claims 19 and 39 : Pizano discloses a method and apparatus as per claims 18 and 38 
above, however failing to distinctly disclose wherein a new copy of an annotated message is 
created. However, Pizano discloses wherein an annotated message is saved for use at a later 
time. 

Therefore, it would have been obvious to one of ordinary skill in the art at the time the 
invention was made to create another copy since it was known in the art that if the capability to 
save a document or message is present, it is common knowledge within the computing arts that it 
is also possible to recreate said document a multitude of times. One of the key advantageous 
features of digital storage is the constant reproducibility of results useful in 'backing up' 
important documents. This allows for the storage of a master copy on a server in the event that 
an important annotated message becomes lost or corrupted, while still providing other copies to 
be distributed to the people that the message was originally intended for. 

Conclusion 

9. The prior art made of record and not relied upon is considered pertinent to applicant's 
disclosure. Wycherley et al. (USPN 5,163,081), Haskell et al (USPN 5,890,120), Alfred et al. 
(USPN 5,894,504), and Towell (USPN 5,911,129) all disclose the use of well-known ASR 
speech-to-text systems. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Justin W. Rider whose telephone number is (571) 270-1068. The 
examiner can normally be reached on Monday - Thursday 7:30AM - 5:00PM. 
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If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, David R. Hudspeth can be reached on (571) 272-7843. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Information regarding the status of an application may be obtained from the Patent 
Application Information Retrieval (PAIR) system. Status information for published applications 
may be obtained from either Private PAIR or Public PAIR. Status information for unpublished 
applications is available through Private PAIR only. For more information about the PAIR 
system,.see http://pair-direct.uspto.gov. Should you have questions on access to the Private PAIR 
system, contact the Electronic Business Center (EBC) at 866-217-9197 (toll-free). If you would 
like assistance from a USPTO Customer Service Representative or access to the automated 
information system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

J.W.R. 

14 February 2007 




